US005416777A 

United States Patent m tm Patent Number: 5 , 416,777 

Kirkham [45] Date of Patent: May 16, 1995 


[54] HIGH SPEED POLLING PROTOCOL FOR 
MULTIPLE NODE NETWORK 

[75] Inventor: Harold Kirkham, Sunland, Calif. 

[73] Assignee: California Institute of Technology, 

Pasadena, Calif. 

[21] Appl. No.: 29,620 

[22] Filed: Mar. 11, 1993 

Related U.S. Application Data 

[63] Continuation-in-part of Ser. No. 683,269, Apr. 10, 
1991, Pat. No. 5,341,372. 

[51] Int. Cl.* H04L 5/22; H04Q 11/04 

[52] U.S. a 370/85.8; 370/95.2; 

340/825.08; 340/310.06 

[58] Field of Search 370/13.1, 16, 16.1, 

370/60, 85.6, 85.7, 85.8, 85.12, 85.14, 85.15, 
94.1, 95.1, 95.2; 340/825.07, 825.08, 310 A, 310 

R 

[56] References Cited 

U.S. PATENT DOCUMENTS 
4,419,666 12/1983 Gurr et al 340/825.06 


4,638,298 1/1987 Spiro 340/310 A 

4,727,475 2/1988 Kiremidjian 340/825.08 X 

4,829,297 5/1989 Ilg et al 370/85.8 X 

4,964,095 10/1990 Tyrrell et al 370/16 X 

4,980,913 12/1990 Skret 340/825.08 X 

5,038,140 8/1991 Ikeuchi 340/825.08 X 

5,175,677 12/1992 Kushiro et al 340/310 A 


Primary Examiner — Melvin Marcelo 

Attorney, Agent, or Firm — Robert M. Wallace; Michael 

L. Keller 

[57] ABSTRACT 

The invention is a multiple interconnected network of 
intelligent message-repeating remote nodes which em- 
ploys a remote node polling process performed by a 
master node by transmitting a polling message generi- 
cally addressed to all remote nodes associated with the 
master node. Each remote node responds upon receipt 
of the generically addressed polling message by trans- 
mitting a poll-answering informational message and by 
relaying the polling message to other adjacent remote 
nodes. 

48 Claims, 7 Drawing Sheets 
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HIGH SPEED POLLING PROTOCOL FOR 
MULTIPLE NODE NETWORK 

BACKGROUND OF THE INVENTION 
ORIGIN OF THE INVENTION 

The invention described herein was made in the per- 
formance of work under a NASA contract, and is sub- 
ject to the provisions of Public Law 96-517 (35 USC 
202) in which the Contractor has elected to retain title. 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application is a continuation in part of U.S. pa- 
tent application Ser. No. 07/683,269 filed Apr. 10, 1991 
by Harold Kirkham entitled “Protocol for Multiple 
Node Network” and assigned to the assignee of the 
present application (hereinafter referred to as “parent 
application”, the disclosure of which is incorporated 
herein by reference, now U.S. Pat. No. 5,341,372. 

TECHNICAL FIELD 

The invention is a communication network of inter- 
connected zones of intelligent nodes which employs a 
high speed polling process performed by nodes which 
are master nodes governing respective ones of the 
zones. 


BACKGROUND ART 

The parent application identified above describes a 
communication network of nodes, each of the nodes 
including a node processor for relaying messages be- 
tween others of the nodes. A plurality of links connect 
the nodes in multiple rings of nodes, the network being 
divided into plural zones wherein each node responds 
only to a master node in the local zone. Those nodes 
located at boundaries between adjacent zones are gate- 
way nodes and respond to master nodes of the adjacent 
zones, each of the gateway nodes being connected to 
nodes in adjacent zones of the network. Each node 
processor performs a distributed protocol for terminat- 
ing a message if the message or a reply to the message 
from another node has been previously received or seen 
at the node. The node processors of the master nodes 
perform polling by transmitting a message authorizing a 
particular one of the other nodes in the local zone to 
transmit a new message, while the node processors in 
other nodes transmit a new message only upon receipt 
of the polling message from the local master node au- 
thorizing the particular node to transmit a new message. 
The polling feature permits all control of communica- 
tion in the network to be concentrated in the master 
nodes. 

One feature which maximizes the reliability of such a 
communication network is that the transmitting and 
relaying of messages (including polling messages) by 
each node in the network is performed in accordance 
with a flooding method in which each node broadcasts 
the message it is transmitting or relaying to all adjacent 
nodes. As a result, a message transmitted on the net- 
work will be broadcast eventually to all nodes, but, 
because of the “antibody” algorithm performed by each 
node (in which the node kills any message it has previ- 
ously transmitted), the message is repeated by each 
node only once. The method of the invention “floods” 
the network with the message and chooses the shortest 
path between the transmitting and receiving nodes be- 
cause it chooses all paths. Reliability of such a network 
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is maximum because the loss of a single link (or even 
several links in most cases) cannot prevent the message 
from eventually reaching its destination, because the 
message travels on all links. 

5 The entire network is monitored by each master node 
periodically polling all nodes within its zone. In doing 
so, the master node transmits a polling message ad- 
dressed to a certain node, to which only the addressed 
node responds with an answering message. Once it 
10 receives the answering message, the master node re- 
peats the process for the next node until all nodes in the 
zone have been polled. Thus, the master node transmits 
a succession of polling messages to successive nodes and 
receives successive responses. In the parent application, 
1 5 both the polling message and the answering message are 
flooded throughout the entire zone of the network. The 
poll message may be a request for data or a command to 
perform some function at the node: the network opera- 
tion is the same. 

20 

While the foregoing provides an orderly and highly 
reliable polling system, it consumes a great deal of time 
in polling all nodes, which slows down the routine 
process of data acquisition, the primary application for 
25 which the protocol of the present invention is intended. 
This is because each polling message must be relayed 
through intervening nodes to the message’s destination 
node, the requested operation (data acquistion or con- 
trol) must be performed, that node’s response must be 
30 relayed back and then the foregoing process must be 
repeated with the next node to be polled. Thus, the 
polling time for a network increases rapidly as a func- 
tion of the number of nodes, a significant disadvantage. 
For example, in a simple version of the type of network 
35 described in the parent application comprising (in this 
example) a ring of ten nodes, one of which is a master 
node, polling of all nodes by the master node would 
require a total of 50 successive message transmissions 
(“hops”) between adjacent nodes. Nevertheless, it has 
40 seemed that the disadvantage of the time required to 
poll the network was justified by the inherent reliability. 

Accordingly, it is an object of the invention to reduce 
the amount of time required to poll all nodes without 
concomitantly reducing the reliability of the network. 

45 SUMMARY OF THE INVENTION 

The present invention is an improvement in the type 
of network disclosed in the parent application which 
greatly reduces the number of “hops” required to poll 
50 all nodes without significantly reducing the reliability of 
such a network. Specifically, the succession of polling 
messages addressed to different individual nodes is re- 
placed by a single polling message not addressed to any 
particular node (or, equivalently, addressed to all 
55 nodes), so that it elicits a response from each node it 
encounters. The first node to receive the polling mes- 
sage transmits an answering message in the return direc- 
tion (i.e., down the link that the polling message arrived 
from), but not in any other direction. Meanwhile, the 
60 first node broadcasts the polling message in all other 
directions (i.e., down all other links to which it is con- 
nected, except the link down which it transmits the 
answering message). Next, a second node (i.e., the node 
closest to the first node) receives the polling message 
65 relayed by the first node, and the second node follows 
the same procedure previously performed by the first 
node. Specifically, the second node transmits an an- 
swering message to the first node (i.e., down the return 
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direction from which the relayed polling message ar- 
rived at the second node), while simultaneously the 
second node repeats or broadcasts the polling message 
in all other directions. 

In a preferred embodiment of the present invention, 
all nodes are programmed to broadcast any message 
other than a polling message in all directions, so that 
poll-answering messages from remote nodes flood the 
network. Thus, in the foregoing example, the second 
node’s answering message is broadcast by the first node 
on all links to which the first node is connected. 

The advantage of the invention is that the remote 
nodes transmit their answering messages to the master 
node as fast as the polling message travels from node to 
node throughout the network. In contrast, the network 
of the parent application had a delay between succes- 
sive poll-answering messages received at the master 
node corresponding to the transit time of the next pol- 
ling message to the next node to be polled and the tran- 
sit time of the next node’s poll-answering message back 
to the master node. It will be recalled that in the simple 
exemplary network discussed previously with reference 
to the parent application, a total of 50 “hops” were 
required to poll ail nodes. In the present invention, the 
same network layout would require only 10 hops to poll 
all nodes, a factor of 5 improvement in speed where the 
number of nodes is 10. A greater improvement factor is 
achieved in larger networks. 

The reliability is not reduced comcomitantly, how- 
ever (i.e., in the above example it would not be reduced 
by a factor of 5). Since the polling message floods the 
network, the polling process of the present invention is 
susceptible to failure only if the link in the return direc- 
tion is broken sometime during the very short time 
interval after a node has received the polling message 
from the upstream node and before the response is re- 
ceived back at the uptstream node. Thereafter, the mes- 
sages are flooded in the manner described in the above- 
referenced parent application. The time interval re- 
ferred to above is so short that the probability of such a 
failure is negligible. Thus, a negligible decrease in reli- 
ability is incurred for a very large increase in polling 
speed. 

In a variation applicable to the present invention and 
to the above-referenced parent application, some of the 
nodes are programmed to not respond to a general 
polling message, but to respond only to a specific type 
or class of polling message, or to respond only to every 
n th polling message, wherein n is an integer, and is in- 
versely proportional to the relative importance of the 
particular node. This variation further reduces the aver- 
age time required to perform one polling cycle. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the invention are de- 
scribed below in detail with reference to the accompa- 
nying drawings, of which: 

FIG. 1 illustrates a table summarizing how node pro- 
cessors in a multiple node network embodying the in- 
vention are to be programmed in comparison with the 
parent application; 

FIG. 2a is a block diagram of a simple network em- 
bodying the invention as a tutorial example; 

FIG. 2b is a block diagram of one representative 
embodiment of the network of the invention; 

FIG. 3 a is a flow diagram illustrating a distributed 
protocol process of the parent application; 
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FIG. 3b is a flow diagram of a distributed protocol 
process employing the preferred embodiment of the 
high speed polling process of the present invention; 

FIG. 3c is a flow diagram of a distributed protocol 
5 process employing an alternative embodiment of the 
high speed polling process of the present invention; 

FIG. 4 is a block diagram of a typical node of the 
network of FIG. 2; 

FIG. 5 illustrates an architecture for implementing 
10 the process of FIG. 3 in the network of FIG. 2; 

FIG. 6 illustrates a preferred block format for mes- 
sages employed in the embodiment of FIG. 2. 

FIG. 7 illustrates one embodiment of the invention 
including a hybrid dual-level network. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Distributed Protocol of the Parent Application 

The network protocols of the parent application were 
20 developed to meet the requirements of communicating 
particularly for the purpose of data acquisition in an 
electric power distribution system. Maximum reliability 
was ensured by the use of network flooding, in which 
every communication node repeated every message not 
25 intended for it. Messages previously repeated by a node 
were removed (i.e., not repeated again) by that node. 
Access to the network was controlled centrally by a 
polling mechanism. No node was allowed to transmit 
(except as a repeater), unless it was polled by the master 
30 station with a polling message bearing the node’s ad- 
dress. While this leads to a controlled and orderly sys- 
tem, it slows down the routine process of data acquisi- 
tion. While the channel capacity of the prototype sys- 
tem of the parent application is 10 Mb/sec, the effective 
35 speed is much slower. The programming of each node 
in the foregoing system of the parent application is 
summarized in the first row of the table of FIG. 1. 
High Speed Polling Process of the Present Invention 

The effective speed is significantly increased in the 
40 high speed polling protocol of the present invention by 
programming the microprocessor of each node in ac- 
cordance with that row of the table of FIG. 1 which is 
labelled “PREFERRED EMBODIMENT”. Before 
discussing the table of FIG. 1 in detail, however, the 
45 physical structure of a network embodying the present 
invention will first be described with reference to FIG. 
2a. 

Consider the ring of remote units labelled nodes 1 
through 9 and their master node in the network of FIG. 
50 2a. In the polling method of the parent application, the 
master node would send a poll (which is a command or 
a request for data) to node 1 first. The poll has to travel 
the length of one fiber (i.e., the optical fiber between the 
master node and node 1) to reach its destination. This 
55 may be thought of as one “hop”. Node 1 responds by 
transmitting a poll-answering message, which reaches 
the master node after a second “hop” in the opposite 
direction over the same cable. Therefore, after two 
“hops” the master has received the requested data, and 
60 polls node 2. This second poll specifies the address of 
node 2 and therefore is relayed (rather than answered) 
by node 1 and reaches its destination after a total of two 
hops. The poll-answering message from node 2 arrives 
at the master after a further two hops. Altogether, fifty 
65 hops are required for the master node to collect the data 
from the 9 remote nodes (nodes 1 - 9 ) of FIG. 2a. 

In accordance with the high speed polling protocol 
of the present invention, the polling message is a broad- 
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cast message specifying a generic destination address 
(or no address at all) to which each of the nodes 1-9 
responds upon receipt. The first node to receive the 
polling message responds with a poll-answering mes- 
sage in the return direction and simultaneously repeats 5 
the polling message in the onward (all other) directions. 

In the case of the ring of nodes 1 through 9 in FIG. 2a, 
the master node transmits the polling message at both of 
its ports simultaneously. Nodes 1 and 9 will receive the 
message first and respond simultaneously so that their 10 
poll-answering messages will arrive simultaneously at 
the two ports of the master node to which they are 
connected. This means that the master node must be 
programmed to separately buffer messages arriving 
simultaneously at its two ports. The same analysis ap- 15 
plies at any node located where the network branches. 

At the end of two hops, then, the master node has 
received the data from the closest two nodes (nodes 1 
and 9), and the next two closest nodes (nodes 2 and 8) 
receive the polling message. After ten hops, the data 20 
from all nodes have been received at the master. This 
represents a performance improvement of a factor of 5 
in speed. Acquiring data in the present invention from 
all nodes takes no more time than acquiring data from 
the most distant node alone, a significant advantage. 25 

There are no message collisions and no unpredictable 
delays. In a more compicated topolgy, these advantages 
are retained. There may be the need sometimes to buffer 
the data, but this does not represent a significant draw- 
back. The approach works because, at any general 30 
node, the polling message is bound to arrive first by the 
shortest path, and any node along this path that is closer 
to the master has already seen the polling message, 
responded and is idle. 

In the event that the devices being served by the 35 
network operate more slowly than the network itself, 
the time taken to read in the polling message and the 
time taken to insert the response back into the network 
could be large compared to the time taken to poll the 
entire network. In this case, the relative timing of the 40 
responses cannot be predicted based on the order of 
polling. As the responses are being passed to the master, 
the liklihood of two different messages arriving at a 
node nearly simultaneously increases. It is possible to 
imagine a situation in which, as messages are handled at 45 
junction or intersection nodes, the buffers at some par- 
ticular intersection node all become full. Once this has 
happened, the arrival of further messages would cause 
loss of data. 

Some mechanism that performs the function of con- 50 
gestion control can be used to prevent the loss of data. 

In implementing the present invention, the use of hand- 
shaking (the exchange of signals to indicate readiness to 
receive data and acknowledge its reception) between 
adjacent nodes is not required. This handshaking can 55 
sometimes be used to avoid congestion in the network, 
but it can sometimes cause problems in the case of low- 
grade lines. (Fiber optics are generally high-grade, 
which permits avoidance of handshaking without incur- 
ring a significant increase in the number of corrupt 60 
messages.) In the absence of handshaking, some other 
form of flow control can be used. 

In the present invention, an approach that sends a 
signal from a node approaching a condition of a full 
buffer to all its neighbors to inhibit further sending is 65 
preferable. The node sends a signal that indicates the 
neighbors are clear to send when the buffer is no longer 
as full. This kind of flow control is well-known, an 
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example being the X-ON/X-OFF protocol. Other con- 
gestion control methods are known, and may function 
with equal effect. 

There is a very small decrease in reliability compared 
to the original protocols described in the application 
referenced above. If the network is damaged along a 
fiber connected to a responding node during the short 
time interval between the receipt of the poll and the 
receipt of the response, the response will not arrive at 
the master node. In the parent application, a copy of the 
response would be flooding out along all other fibers, 
and while the response might take longer to return than 
the polling message was in transit, it would have arrived 
if any duplicate path existed. In the present invention, 
only the shortest path carries the response on its first 
hop (which is why the method has slightly increased 
vulnerability to failure). All other fibers are carrying 
the polling message. This is a trade-off that would be 
acceptable in most applications. The method of the 
present invention uses flooding for propagating all mes- 
sages throughout the network after this first hop, and 
(as in the above-referenced parent application) does not 
require any node to know the configuration of the net- 
work. 

Each of the foregoing features of the invention is 
readily implemented by the skilled worker in view of 
the foregoing teachings by programming appropriate 
changes in the software instructions stored in the micro- 
processor memories of each node and of the master 
node. 

Programming the Node Microprocessor in Accordance 
With Each of the Embodiments of the High Speed 
Polling Protocol of the Present Invention 

The microprocessor of each remote node is pro- 
grammed with instructions which implement the high 
speed polling protocol of the present invention. As 
mentioned previously, the table of FIG. 1 summarizes 
the variables that must be programmed (across the top 
of the table). The first row in the table of FIG. 1 (la- 
belled “PARENT APPLICATION”) corresponds to 
the network of the parent application, and is provided 
for the sake of comparison with the present invention. 
The second row (labelled “PREFERRED EMBODI- 
MENT”) corresponds to the present invention. The 
third row (labelled “ALTERNATIVE EMBODI- 
MENT”) corresponds to an alternative embodiment of 
the invention. 

The variables that must be programmed to realize the 
high speed polling protocol of the present invention 
include (reading from left to right across the top of the 
table of FIG. 1): what nodes the polling message is 
addressed to, how the polling message is relayed from 
node to node, the direction in which the node transmits 
its poll-answering message, the timing of relaying the 
polling message relative to the transmission of the poll- 
answering response. 

In the parent application, these variables are pro- 
grammed as follows in accordance with the row of the 
table of FIG. 1 labelled “PARENT APPLICATION”: 
the polling message is addressed to a particular target 
node, and is relayed by flooding throughout the net- 
work; the poll-answering message is broadcast on all 
ports of the node so as to permit it to flood the network; 
and, the poll-answering messages from other remote 
nodes are relayed by broadcasting them on all ports of 
the node so that such messages flood the network. 

In the preferred embodiment of the present invention, 
these variables are programmed in accordance with the 
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row of the table of FIG. 1 labelled “PREFERRED 
EMBODIMENT” as follows: the polling message is 
addressed generically to all nodes controlled by the 
master node 14 and is relayed by each node on all ports 
other than the port on which the polling message was 
received; the poll-answering message is transmitted by 
the responding node on the port from which the polling 
message was received, and the timing is such that the 
transmitting of the poll-answering message and the 
relaying of the polling message is simultaneous (or 
nearly so); and, poll-answering messages received from 
other nodes are relayed by broadcast on all ports so as 
to flood the network with such messages. 

In an alternative embodiment of the present inven- 
tion, these variables are programmed in accordance 
with the row of the table of FIG. 1 labelled “ALTER- 
NATIVE EMBODIMENT” as follows: the polling 
message is generically addressed to all remote nodes as 
in the previous embodiments, but is relayed by transmit- 
ting it on all ports of the node so that it floods the net- 
work; the poll-answering message is transmitted on all 
ports of the node so that it too floods the network, while 
its timing is sequential with respect to (i.e., before or 
after) the relay broadcast of the polling message; and, 
poll-answering messages received from other remote 
nodes are broadcast on all ports of the receiving node so 
that such messages flood the network. 

Typical Network In Which the Present Invention is 
Employed 

In the multiple interconnected ring network of FIG. 
2b, any node 16 or master node 14 can transmit a mes- 
sage in the network. In order to effect the distributed 
protocol strategy, every message contains a unique 
identifying number that can be stored in every node 16 
that it passes through. Since the operation of the nodes 
16 in the separate rings 22 is assumed to be independent, 
the information required to identify a message uniquely 
can be based on the source address of the originating 
node and the time the message was originated, in one 
embodiment of the invention. This address may either 
be a logical address or the “street” address of the origi- 
nating node. Each node 16 has a memory stack in which 
the identifying numbers of all passing messages are 
stored for future reference. 

At all nodes, any received message (except a generi- 
cally addressed polling message in certain embodiments 
of the present invention) is retransmitted on all outgoing 
lines, unless the message has been seen before, or is 
addressed to the node in question. Another approach 
would inhibit the retransmission of a message if the 
reply to it has already been seen at the node. By adopt- 
ing such a strategy, a message inserted anywhere into 
the multiple interconnected ring network of FIG. 2b 
will be broadcast to all nodes 16. Furthermore, the 
message will not be repeated by a given node more than 
once. All links between nodes carry the message exactly 
once. The process is therefore as economical in opera- 
tion as a single ring with an active monitor node. It is in 
some ways more efficient than a method which relies on 
some central unit working out a route for messages to 
go from node to node. The method of the invention 
“floods” the network with the message and chooses the 
shortest path between the transmitting and receiving 
locations because it chooses all paths. Transmission 
delay is therefore minimized. In flooding the network 
with the message, many copies of the message circulate 
simultaneously in different ones of the multiple inter- 
connected rings of the network of FIG. 2b , and this 
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process propagates throughout the network until every 
link has passed the message once. As a result of such 
“flooding”, several copies of each message will be re- 
ceived at the destination node. 

5 Because fiber optics are used in the preferred embodi- 
ment, communication reliability is so high that error 
correction is unnecessary. Should a message be cor- 
rupted before reaching its destination by one particular 
path, another “good” copy will arrive over a different 
10 path in most cases. Since the several copies of the re- 
ceived message will travel along different paths, inter- 
ruption of a given path will not prevent arrival of at 
least one copy of the message. Therefore, reliability is 
maximized. The network will function even when fibers 
15 are broken disconnecting some nodes from one or more 
their neighbors. 

The distributed protocol process of the invention 
resembles the working of the human body’s immune 
system. The first time a T-cell in the immune system is 
20 exposed to an invading organism, it learns to recognize 
the organism as “non-self 5 . On a second exposure, the 
T-cell stimulates production of antibodies that kill the 
invader. In the present invention, the messages are anal- 
ogous to the invader, and they wander throughout the 
25 network of FIG. 2b as far as available communication 
channels will allow. On first exposure to a message, 
each node 16 extracts and stores information that will 
allow it, on a second exposure, to kill the message. 
Distributed Protocol Process of the Parent Application 
30 The distributed protocol process of the parent appli- 
cation performed by each node 16 in the multiple inter- 
connected ring network of FIG. 2b is illustrated in FIG. 
3a. It begins as a message is received by a particular one 
of the nodes 16 (block 48 of FIG. 3a). The node 16 first 
35 determines the unique identification number of the re- 
ceived message and determines whether that same num- 
ber (or a greater number corresponding to the response 
to the message) was previously stored in the node’s 
memory (block 50 of FIG. 3a). If the node finds the 
40 same identification number (or the greater number cor- 
responding to the response to the message) stored in its 
memory (YES branch of block 50), then the node 
“kills” the message by not retransmitting it to other 
nodes and taking no other action with respect to the 
45 message (block 52 of FIG. 3a). Otherwise (NO branch 
of block 50), the node copies and stores the message’s 
identification number in a memory stack (block 54 of 
FIG. 3a). 

In the remaining steps of the process of FIG. 3a, it is 
50 assumed that the message includes data bits identifying 
the location of the message origin as well as its destina- 
tion in the network of FIG. 2b. The node determines 
whether it is the node which previously originated the 
received message (block 56 of FIG. 3a). If so (YES 
55 branch of block 56), the node “kills” the message by 
taking no further action (block 58 of FIG. 3a). Other- 
wise (NO branch of block 56), the node next determines 
whether it is the destination of the message (block 60 of 
FIG. 3a). If the message does not bear the destination 
60 address of the present node (NO branch of block 60), 
the node repeats the message to the other nodes in the 
network (block 62 of FIG. 3a). Otherwise (YES branch 
of block 52), the node decodes the message and re- 
sponds accordingly (block 64 of FIG. 3a). For example, 
65 if the message is a diagnostic message, the node per- 
forms the tasks required in the message. It should be 
noted that the steps of blocks 56 and 58 may be unneces- 
sary in some embodiments of the invention where, for 
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example, the network topology is such that the originat- 
ing node will never receive copies of the messages it 
originates. 

Polling Protocol of the Parent Application 
The distributed protocol control process of FIG. 3 a 5 
permits the use of centralized polling. By program m ing 
each node 16 to transmit new data only when it receives 
a specific request to do so from its local master node 14, 
the master node 14 can sequentially poll all of its local 
nodes without having to be connected directly to them. 10 
This solves the problem of several nodes independently 
deciding to transmit different messages which reach the 
master node 14 or some other point in the network 
simultaneously. Such polling is not cumbersome in the 
network of FIG. 2b because scanning all of the nodes 15 
should occupy only a few tens of milliseconds. If the 
message from one node is 1000 bits long and if there are 
100 nodes, a complete scan comprises 10 5 bits. Using 
optical fiber links, the anticipated data rate in the net- 
work of FIG. 2b is 10 7 bits per second, so that the time 20 
occupied by all the data is 10~ 2 seconds. The scan time 
will be a few times larger than this, since data from each 
node must be transmitted to another node, error- 
checked and re-transmitted. In the improvement de- 
scribed below, this scan time is minimized to speed up 25 
data acquisition by the master node 14. 

Preferred Embodiment of the High Speed Polling Pro- 
tocol of the Present Invention 
In the present invention, this scan time is significantly 
reduced from that of the network described in the par- 30 
ent application by employing a polling message which is 
not addressed to any particular node (for example, by 
designating a “generic destination address” or no desti- 
nation address at all), so that each node responds to the 
polling message as it is received. Alternatively, this 35 
effect is accomplished by simply programming the mi- 
croprocessor in each remote node 16 to respond to any 
received message identifying itself as a polling message 
as if the polling message had been specifically addressed 
to that node. In any case, to poll all of its remote nodes, 40 
the master node 14 transmits a single “generic” polling 
message once on all of the links 18 connected to it. This 
polling message is first received at each of the remote 
nodes 16 which are connected directly to the master 
node 14 (as distinguished from those remote nodes con- 45 
nected indirectly — through other remote nodes — to the 
master node 14). After a delay time required for the 
nodes to relay the polling message, the next set of re- 
mote nodes, namely those of the remote nodes 16 which 
are one node removed from the master node 14, receive 50 
the polling message. Again, after an equal delay time, 
the following set of nodes, namely those of the remote 
nodes 16 which are two nodes removed from the master 
node 14, receive the polling message, and so forth, until 
after a number of such delay times all remote nodes 16 55 
have received the polling message. 

Referring to FIG. 3b, the manner in which the micro- 
processor of each remote node 16 is programmed to 
respond to the “generic” polling message follows the 
process of FIG. 3a, except that after the YES branch of 60 
block 60, the following is performed: The remote node 
16 senses whether the message is a generically ad- 
dressed polling message (block 200 of FIG. 3b). Such a 
generically addressed polling message was treated in 
the previous step of block 60 as designating that node as 65 
its destination, since such a polling message designates 
all remote nodes 16 as its destination. In order to distin- 
guish generically addressed polling messages from all 


10 

other types of messages, all master nodes 14 are pro- 
grammed to include an identifier within their generi- 
cally addressed polling messages and each remote node 
is programmed to recognize that identifier so as to re- 
spond to the polling message. If the message is not a 
generically addressed polling message (NO branch of 
block 200), the process carries on with the step of block 
64 as in FIG. 3a. Otherwise (YES branch of block 200 
of FIG. 3b), it determines which one of its incoming 
ports (optical fiber cables) received the polling message 
(block 202 of FIG. 3b). User hardware connected to the 
remote node 16 constructs an answering message re- 
sponsive to the polling message (or else retrieves an 
answering message it has already constructed from 
memory) and the remote node 16 transmits the answer- 
ing message back down the same port (optical fiber 
cable) toward the direction from which the polling 
message was received (block 204 of FIG. 3b). The re- 
mote node 16 broadcasts the received polling message 
on all of its other ports (block 204 of FIG. 3b). Depend- 
ing upon the speed of the user hardware connected to 
the remote node 16, the transmission of the poll-answer- 
ing message may be virtually simultaneous with the 
broadcasting of the polling message or may be delayed. 
Generally, when receiving messages from other remote 
nodes and relaying them onward, a remote node 16 
broadcasts such messages on all of its ports (optical 
fibers). This includes poll-answering messages from 
other remote nodes whose ultimate destination is the 
master node 14. 

Alternative Embodiment of the High Speed Polling 
Protocol 

In a different approach, each remote node 16 broad- 
casts on all of its ports (optical fibers) the generic pol- 
ling message as received and all poll-answering mes- 
sages, including those it generates itself as well as those 
received from other remote nodes, so that the “generic” 
polling message and each poll-answering message from 
each remote node 16 flood the network. In this embodi- 
ment, the transmitting of the polling message and of the 
poll answering message generated within the particular 
remote node 16 is not simultaneous as in the first em- 
bodiment, but rather is sequential. Referring to FIG. 3c, 
upon receiving a generically addressed polling message 
(YES branch of block 200), each remote node 16 first 
broadcasts the polling message previously received on 
all of its ports (block 210) and then, after some delay 
attributable to user hardware connected to the node, 
broadcasts its poll-answering message on all of its ports 
(block 212). 

Hierarchy of Nodes 

In order to permit more frequent polling of critical 
nodes and less frequent polling of less important nodes, 
the individual remote nodes may be programmed to 
respond only to a special class of polling messages. The 
class of a polling message may be determined by the 
node from the contents of predetermined portions or 
data fields of the polling message. In this case, each 
message includes a portion stating the class of the mes- 
sage (e.g., one of a predetermined set of integers). The 
node is programmed to respond only to those polling 
messages having a particular class or range of classes. 

Alternatively, the individual remote nodes may be 
programmed to respond only to every n th polling mes- 
sage received, wherein n is an integer inversely propor- 
tional to the importance of the particular remote node 
16 relative to all other remote nodes in the network, or 
they may be programmed to respond only to a special 
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class of polling messages. The number n is any integer 
and may even assume the value of infinity, in which 
case the node is programmed to never respond to a 
polling message. For the most important nodes, n = 1. 

In accordance with the foregoing polling feature of 5 
the invention, the process of generating a message by 
either a master node 14 or a node 16 which has received 
a message requesting transmission is as follows: 

1) create information portion of message; 

2) append a unique identification number to the mes- 10 
sage; 

3) append the identification of the originating node 

and the destination node (which is all nodes within 
the master node's zone, in the case of a generically 
addressed polling message); and 15 

4) transmit the message. 

Transferring Control to the Master node of Another 
Zone 

Another feature described in the above-referenced 
parent application permits compensation for the loss of 20 
one of the master nodes 14 in the network. Specifically, 
another master node (or a unit higher in the control 
hierarchy) detecting the loss can remotely re-program 
one or more of the nodes 16 to no longer isolate the 
zone of the network served by the lost master node 14. 25 
This enables a master node serving an adjacent zone of 
the network to take over the monitoring and control of 
all the nodes in the zone of the lost master node. In 
accordance with this feature, each of the nodes 16 may 
be programmed or re-programmed by a message di- 30 
rected to it from any master node 14. For example, each 
node 16 is programmed to re-transmit a received mes- 
sage destined for another node or to respond to a re- 
ceived message destined for the node itself, provided 
that the message identifies its source as the master node 35 
14 of the local zone of the node. If failure of the local 
master node is detected, the master node 14 of an adja- 
cent zone can send a message to each of the nodes in the 
zone of the failed master node instructing them to begin 
responding to messages whose source is the adjacent 40 
zone’s master node. Alternatively, the remote nodes 16 
can be programmed to respond to any master node (i.e., 
a master node in another zone) if their own master (i.e., 
the master controlling their own zone) has not polled 
them within some predetermined time. 45 

Structure of a Typical Node 

The preferred structure of a simple implementation of 
a typical one of the nodes 16 is illustrated in FIG. 4. A 
similar structure may also be used to implement each of 
the master nodes 14 as well as each of the gateway 50 
nodes 20. As mentioned previously herein with refer- 
ence to FIG. 26, each of the links 18 is preferably an 
optical fiber link. Each link 18 accommodates two-way 
traffic and for reasons of economy comprises two opti- 
cal fibers. The apparatus of FIG. 4 can function as ei- 55 
ther an ordinary node 16 which is connected to two 
other nodes 16 via optical links, as an intersection node 
16 connected to more than two other nodes via more 
than two optical links or as a gateway node 20 which is 
capable of responding to more than one master node 14 60 
and which (in the embodiment of FIG. 2b) is connected 
to four other nodes 16 via four optical links. Also, if the 
apparatus is used in a master node 14, it may be con- 
nected to any number of other nodes 16. However, 
FIG. 4 only shows connections to two bi-directional 65 
optical links 18 a, 18 b comprising outgoing fiber optic 
cables 18a-l and 186-1 and incoming fiber optic cables 
18a-2 and 186-2, respectively, additional links being 
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includable. A set of optical bypass switches 66, 68 en- 
able an incoming message to be relayed directly to the 
next node. When a node 16 or 20 is in service (i.e., is not 
bypassed), it acts as a repeater for incoming signals. The 
advantage of such frequent repetition and boosting of 
the optical signals throughout the network is that even 
slight optical dispersion effects that might appear be- 
cause of the use of low-grade optical fiber will not accu- 
mulate in the system. 

In the preferred embodiment of the invention, the 
switches 66 and 68 perform a “deadman switch” func- 
tion whenever the node or its power supply is not func- 
tioning, in which any incoming message from one of the 
optical links 18# or 186 is passed directly to the other 
one via the optical fibers labelled “optical bypass” in 
FIG. 4. The advantage of this feature is that the failure 
of a node cannot interrupt the relaying of messages 
throughout the network. 

As shown in FIG. 4, a microprocessor 80 receives 
signals from and transmits signals to the optical links 
18 a, 186. Any received signals from the incoming opti- 
cal cables 18a-2 and 186-2 are converted from optical to 
electrical signals by respective optical-to-electrical con- 
verters 72, 74. Any signals generated by the micro- 
processor 80 for transmission on either of the outgoing 
fiber optic cables 18a-l, 186-1 are converted from elec- 
trical to optical signals by respective electrical-to-opti- 
cal converters 76, 78. Since the microprocessor 80 typi- 
cally transmits and receives bytes of plural data bits in 
parallel and since the links 18 typically carry the data in 
bit serial form, serial/parallel data conversion between 
the microprocessor 80 and the “left-to-right” link com- 
prising the fiber optic cables 186-2 and 18a-l is per- 
formed by a serial/parallel converter 84. Likewise, 
serial/parallel data conversion between the micro- 
processor 80 and the “right-to-left” link comprising the 
fiber optic cables 18a-2 and 186-1 is performed by a 
serial/parallel converter 82. A node memory 86 is typi- 
cally part of the memory in microprocessor 80. The 
node memory 86 stores the message identification num- 
ber stack which is required in the distributed protocol 
process of FIG. 3 a. 

Data acquisition and control processing functions 88 
can be performed by the microprocessor 80. The micro- 
processor 80 permits the acquisition and control func- 
tions 88 to interface with the network of FIG. 26. The 
structure of the software and hardware embodied in the 
acquisition and control functions 88 is largely indepen- 
dent of the operation of the network of FIG. 26. For 
reasons of efficiency, hardware attached to the micro- 
processor 80 performs channel encoding and decoding 
of data to be transmitted on or received from the optical 
links 18a, 186. In the preferred embodiment of the in- 
vention, it is anticipated that the links 18 will employ a 
differential Manchester code. Therefore, the micro- 
processor 80 performs or manages other hardware not 
shown in FIG. 4 which performs differential Manches- 
ter encoding and decoding. The microprocessor 80 also 
performs other tasks necessary to interface with the 
network. For example, the microprocessor 80 performs 
the distributed protocol control process referred to 
above in connection with to FIG. 3a. 

One advantage is that the data acquisition and control 
functions 88 may be modified to add new power moni- 
toring or control functions, for example, without requir- 
ing any changes in the network of FIG. 26. It may be 
necessary to provide additional instructions in the mi- 
croprocessor 80 to enable it to communicate with the 
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additional functions. As a result, the network of FIG. 26 
may be continually improved by the addition and re- 
finement of power monitoring and control functions at 
any or all nodes in the network during the lifetime of 
the network. More importantly, new power monitoring 5 
and control software and hardware for insertion in the 
acquisition and control apparatus 88 can be developed 
any time during the life of the network independently 
and competitively for purchase and installation by the 
electric utility company owning the network, provided 10 
the independent developers are apprised of such details 
as the architecture of the microprocessor 80. 

Some examples of peripheral monitoring and control 
functions for the acquisition and control apparatus 88 
are illustrated in FIG. 4. For automatic electric power 15 
distribution control, each node may have high voltage 
apparatus at an adjacent point in a power line coexten- 
sive with the optical links 18c, 186. The high voltage 
apparatus is controlled by a peripheral controller 94 
which receives command signals generated by the data 20 
acquisition and control apparatus 88 through a signal 
conversion device 96. The conversion device 96 may, 
for example, be a digital-to-analog converter. An isola- 
tor 98 provides high voltage isolation between the con- 
troller 94 and the converter 96. 25 

Electric power monitoring may be performed by an 
electrical sensor 100, for example, sensing current in the 
power line. The output of the sensor 100 is converted by 
a conversion device 102 to a digital format for process- 
ing by the acquisition and control device 88. If an opto- 30 
electronic sensor 104 is employed, its output is con- 
verted from an optical signal to an electrical signal by a 
converter 104 (which also provides high voltage isola- 
tion). The converted electric signal is converted to a 
digital format by a conversion device 108 for processing 35 
by the acquisition and control apparatus 88. 

In modifying the acquisition and control apparatus, 
additional processors may be installed as additional 
elements of the apparatus 88 with new software govern- 
ing their operation to implement the added functions. 40 
Thus, the acquisition and control apparatus 88 may 
include a number of microprocessors and memories, for 
example. 

Programming Architecture 

The architecture of the node of FIG. 4 is illustrated in 45 
FIG. 5. The functions of the node, which may be imple- 
mented with the microprocessing devices 80 and 88 
with pre-programmed micro-instructions or software, 
comprise seven layers: an application layer 110, a pre- 
sentation layer 112, a session layer 114, a transport layer 50 
116, a network layer 118, a link layer 120 and a physical 
layer 122. In the preferred embodiment of the invention, 
each of the layers except the physical layer 122 is imple- 
mented as software or a set of program instructions 
stored in the memories of appropriate node processors. 55 
The order of these layers is consistent with the well- 
known Open System Interconnection (OSI) model of 
the International Standards Organization (ISO) (pub- 
lished in Zimmerman, H., (1980) “OSI Reference 
Model — the ISO Model of Architecture for Open Sys- 60 
terns Interconnection”, IEEE Transactions on Commu- 
nications . , Vol. COM-28, No. 4, April, pp. 425-432). 

In the invention, the applications layer 110 consists of 
the control and monitoring functions of power distribu- 
tion system operation, or can be other functions in other 65 
applications of the present invention. As described pre- 
viously herein, the polling function performed by the 
master nodes 14 permits all communication control in 
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the network of FIG. 2b to be concentrated in the master 
nodes 14. The applications layer 110 is largely concen- 
trated in the master nodes 14. In the preferred embodi- 
ment, the applications layer 110 is implemented as a set 
of program instructions stored in the memory of the 
processor of each master node 14. If the network of 
FIG. 2b is associated with an electrical power distribu- 
tion network, then the applications program instruc- 
tions carry out processes for the master node 14 to 
instruct appropriate ones of the nodes 16 in its zone to 
monitor and report certain power conditions at remote 
locations and to perform certain power control func- 
tions. In this embodiment, the remote nodes 16 would 
store relatively few of the applications layer program 
instructions in order to execute appropriate commands 
from their master node 14. 

The presentation layer 112 converts data descriptions 
used by applications software in the application layer 
110 into data addresses recognized by lower layers in 
the architecture of FIG. 5. The presentation layer 112 is 
implemented in the microprocessor 80. 

The session layer 114 performs the polling function 
described above facilitated by the steps of blocks 60, 62 
and 64 in FIG. 3 a and is also implemented in the micro- 
processor 80. 

The transport layer 116, in one embodiment, may 
perform error detection and correction and is likewise 
implemented in the microprocessor 80. In addition, the 
transport layer 116 is also able to detect variations in the 
network layer 118, for example to perform network 
diagnostics or to use different embodiments of this in- 
vention. 

The network layer 118 is implemented in the micro- 
processor 80 and performs the distributed protocol 
control process of the steps of blocks 48, 50, 52 and 54 
in FIG. 3a. This process floods the network of FIG. 2b 
with many copies of the same message by virtue of the 
message replication operation performed by the nodes 
16 or 20, as described hereinabove. 

The data link layer 120 frames the data into blocks, in 
accordance with well-known techniques (such as AN- 
SI/IEEE Standard 802.3) and is implemented in hard- 
ware attached to the microprocessor 80. However, 
unlike the prior art, this layer issues no re-transmission 
requests in the event of an error. There seems little to be 
gained by retaining the conventional technique of mes- 
sage receipt acknowledgement. Since fiber optic links 
generally have a bit error rate of 10-' 9 or better, the 
probability of sending an error-free message of 1000 bits 
in the network of FIG. 2b is (1-10~ 9 ) 100 °, which is a 
success probability of 99.99990%. It therefore seems 
inherently wasteful to devote any amount of effort to 
acknowledging successful reception of data. 

The physical layer 122 includes the fiber optic links 
18 of FIG. 2b and also includes non-fiber optic low 
speed links. Therefore, in one embodiment of the inven- 
tion, the physical layer 122 is a hybrid, as illustrated in 
FIG. 7. The primary or fiber optic network consists of 
the fiber optic links 18 and the remote nodes 16 of FIG. 
7, corresponding to the network of FIG. 2b. The sec- 
ondary or non-fiber optic network consists of the power 
line carrier input/outputs 130a and 1306 of the primary 
nodes 16a, 166, and the secondary power lines 132a, 
134a, 1326, 1346 connecting each power customer 136 
with a respective stepdown transformer 138a, 1386. 
Sensors 140 at the customers 136 report their findings 
via power line carrier to the appropriate node 16a, 166. 
If the node 16a obtains a reading from a secondary 
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monitor 140a, for example, it reports this reading to its 
local master node 14 (not shown in FIG. 7). 

The advantage of the hybrid nature of the physical 
layer 22 is that it enables the continued use of existing 
load-control and meter-reading hardware, which in 5 
turn implies minimum need to enter the customer’s 
premises for installation. Further, communication into 
the home can be compatible with other communication 
applications of home wiring (for example the PLBus of 
the Electronic Industries Association (EIA) Home Au- 10 
tomation Standard). An EIA PLBus interface at each 
distribution transformer would allow the utility com- 
pany to accomplish far more control than simple man- 
agement of one load. Not only could there be the capa- 
bility of emergency load-shedding, but a solution to 15 
cold load pickup problems would be available. Other 
features, such as re-setting clocks in subscribers’ homes 
after power failures, may also be developed. 

In cost terms, a hybrid of this kind is certain to be 
competitive if more than one function is to be per- 20 
formed by the distribution automation system. Feeder 
automation functions can be implemented competi- 
tively and demand side management can be added at 
extremely low cost. The small size of the network to be ^ 
covered by the DLC or home wiring system on the 1 
non-fiber optic links (typically 3 or 4 homes) greatly 
eases its communications requirements. Very low 
power, inexpensive modules operating at about 120 kHz 
are widely available, and signalling speeds up to 1200 3Q 
baud are possible. The incremental cost of adding this 
capability and other functions at the customer level 
would be minimized. 

For reasons of cost, the fiber optic links 18 are prefer- 
ably multimode fibers with near-infrared LED transmit- 35 
ters operating at a bit rate of between 10 and 15 MHz. 
The non-fiber optic links in the secondary circuits em- 
ploy low-power power line carrier transmissions, as 
discussed above. 

Message Format 40 

FIG. 6 illustrates one exemplary format for the mes- 
sages communicated in the network of FIG. 2b. Each 
message is a serial packet of bits of which the first block 
170 specifies the message’s unique identification num- 
ber, the second block 172 contains the message data, the 45 
third block 174 specifies the destination address and the 
fourth block 176 specifies the source address of the 
message (i.e., a particular node 16 or 20 or master node 
14). 

In the present invention, in order to accomodate the 50 
generic addressing of polling messages to all nodes 
within a particular zone, for example, the block 174 
containing the destination address data consists of two 
address blocks, namely an upper address block 174a and 
a lower address block 174b specifying the upper and 55 
lower bounds of the address range of the zone all of 
nodes to which the polling message is addressed. All 
remote nodes 16 within a particular zone are addressed 
in a numerical order so that all of their addresses are 
specified by simply specifying the high and low ad- 60 
dresses bounding their range of addresses. 

For this purpose, each node processor 80 is pro- 
grammed to respond if its local address falls within the 
range of addresses between the upper and lower ad- 
dresses contained in the destination address block 174. 65 
For other types of messages which are to be addressed 
to a single node only, the upper and lower addresses in 
the block 174 would be the same address. 
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In one embodiment, the presence of different address 
values in the two address blocks 174a and 114b func- 
tions as a flag to the remote node which distinguishes 
the message as a generically addressed polling message. 
Any message so distinguished is treated in accordance 
with the process such as that described above with 
reference to FIG. 3b. The foregoing is readily imple- 
mented using well-known techniques in the art. 

While the network of FIG. 2b has been described 
above as being co-extensive with an electrical power 
distribution system including plural power substations 
in which each master node 14 is located, the invention 
may also be employed in a manner in which the net- 
work of FIG. 2b is coextensive with the internal nodes 
within a power substation, so that each individual node 
14, 16 or 20 corresponds with an individual location 
within the power substation. 

While the invention has been described in detail by 
specific reference to preferred embodiments thereof, it 
is understood that variations and modifications thereof 
may be made without departing from the true spirit and 
scope of the invention. 

What is claimed is: 

1. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nodes in 
a network of said nodes; 

means for transmitting a polling message addressed to 
at least plural ones of said remote nodes; and 

wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 

wherein each remote node is connected to plural ones 
of said links, and wherein said poll-responsive 
means comprise: 

means for sensing which one of said plural links 
connected to said node said polling message 
arrived on; and 

means responsive to said means for sensing for 
transmitting said poll-answering message on the 
link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 

wherein each of said remote nodes further comprises: 
means for sensing a poll-answering message re- 
ceived on one of said links from another one of 
said remote nodes; and 

means responsive to said means for sensing a poll- 
answering message for transmitting said poll- 
answering message received from said other one 
of said remote nodes on all links to which said 
node is connected. 

2. The communication network of claim 1 wherein 
said poll-responsive means comprises means for re- 
sponding only to a particular class of polling messages. 

3. The communication network of claim 2 wherein 
said class corresponds to contents of a predetermined 
portion of said polling message. 

4. The communication network of claim 1 wherein 
each of said node processor means further comprises 
distributed protocol means for terminating a message 
which has been received at the corresponding node 
more than once. 
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5. The communication network of claim 4 wherein 
said node processor means comprises: 

means for originating a message comprising an infor- 
mation portion; 

means for appending a unique identification number 5 
to said message; 

stack memory means for storing the identification 
number of each received message; and 
wherein said distributed protocol means comprises 
means for comparing the identification number of 1° 
each received message with the identification num- 
bers stored in the stack memory means so as to 
determine whether to repeat the received message. 

6. The communication network of claim 1 wherein: 
said means for transmitting a polling message on said 15 

links comprises a master node in said network, said 
master node being connected by respective ones of 
said links to at least one of said remote nodes; 
said communication network is co-extensive with an 
electrical power distribution network, at least some 2 
of said remote nodes further comprising power 
distribution automation apparatus and said master 
node comprising power substation control unit. 

7. The communication network of claim 6 wherein ^ 
said distribution automation apparatus comprises at 
least one of: 

sensing means for monitoring a parameter of said 
electrical power distribution network, and 
regulation means for controlling apparatus in said 3Q 
power distribution network. 

8. The communication network of claim 7 wherein 
said master node comprises automation processing 
means for executing a set of stored application program 
instructions to manage the distribution automation ap- 
paratus of corresponding remote nodes. 

9. The communication network of claim 8 further 
comprising a set of secondary nodes connected to re- 
spective ones of said remote nodes by secondary links, 
wherein said link means connecting said remote nodes 4 q 
comprise fiber optic cables and said secondary links 
comprise relatively low bandwidth non-fiber optic 
links. 

10. The communication network of claim 9 wherein 
said power distribution network comprises a high-volt- 45 
age primary circuit and a plurality of low-voltage sec- 
ondary circuits receiving power through step-down 
transformer means from said primary circuit, wherein 
said secondary nodes are co-located with respective 
ones of said secondary circuits, said secondary links 50 
comprising power line carrier means for coupling be- 
tween said secondary nodes and said remote nodes 
through said primary and secondary circuits. 

11. The communication network of claim 1 further 
comprising bypass means in each node for permitting 55 
received messages to bypass a node. 

12. The communication network of claim 1 wherein 
said communication network is co-extensive with an 
electrical power distribution substation, at least some of 
said remote nodes further comprising apparatus within 60 
said electrical power distribution substation. 

13. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 65 
nodes; 

a plurality of links which connect said plural nodes in 
a network of said nodes; 
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means for transmitting polling message addressed to 
at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
other of said remote nodes; 
wherein said poll-responsive means comprises means 
for responding to a polling message after receiving 
n polling messages and for refraining from respond- 
ing to intervening polling messages, wherein n is an 
integer individually assigned to an individual node, 
whereby different nodes respond to polling mes- 
sages at different rates. 

14. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plurality of 
remote nodes in a network of said nodes; 
means for transmitting a polling message addressed to 
at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 
wherein said means for transmitting a polling message 
on said links comprises a master node in said net- 
work, said master node being connected by respec- 
tive ones of said links to at least one of said remote 
nodes; 
wherein: 

said remote nodes are divisible into a plurality of 
zones of said remote nodes, each of said zones 
including its own master node connected to at 
least one of the remote nodes within the zone, 
and 

said node processor means further comprises 
means for inhibiting the repeating of received 
messages not originated by a master node in the 
corresponding zone. 

15. The communication network of claim 14 wherein 
each master node further comprises: 

means for broadcasting a changeover message in- 
structing the remote nodes in another zone to re- 
spond to messages originated in the one zone. 

16. The communication network of claim 14 further 
comprising gateway nodes connected to remote nodes 
in adjacent ones of said zones. 

17. The communication network of claim 16 wherein 
said gateway nodes comprise gateway node processor 
means for repeating or responding to received messages 
originated in the adjacent zones. 

18. The communication network of claim 17 wherein 
messages originated in adjacent zones travel along com- 
mon paths shared by the adjacent zones. 

19. The communication network of claim 14 wherein 
said node processor means further comprises means for 
permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 
riding said means for inhibiting. 

20. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 



5 , 416,777 


19 

received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nodes in 
a network of said nodes; 

means for transmitting a polling message addressed to 
at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 
wherein each remote node is connected to plural ones 
of said links, and wherein said poll-responsive 
means comprise: 

means for sensing which one of said plural links 
connected to said node said polling message 
arrived on; and 

means responsive to said means for sensing for 
transmitting said poll-answering message on the 
link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 
wherein said means responsive to said means for sens- 
ing transmits said polling message on all other links 
to which said node is connected; 
wherein said poll-responsive means comprises means 
for responding to a polling message after receiving 
n polling messages and for refraining from respond- 
ing to intervening polling messages, wherein n is an 
integer individually assigned to an individual node, 
whereby different nodes respond to polling mes- 
sages at different rates. 

21. The communication network of claim 20 wherein 
each of said node processor means further comprises 
distributed protocol means for terminating a message 
which has been received at the corresponding node 
more than once. 

22. The communication network of claim 21 wherein 
said node processor means comprises: 

means for originating a message comprising an infor- 
mation portion; 

means for appending a unique identification number 
to said message; 

stack memory means for storing the identification 
number of each received message; and 
wherein said distributed protocol means comprises 
means for comparing the identification number of 
each received message with the identification num- 
bers stored in the stack memory means so as to 
determine whether to repeat the received message. 

23. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nodes in 
a network of said nodes; 

means for transmitting polling message addressed to 
at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 
wherein each remote node is connected to plural ones 
of said links, and wherein said poll-responsive 
means comprise: 
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means for sensing which one of said plural links 
connected to said node said polling message 
arrived on; and 

means responsive to said means for sensing for 
5 transmitting said poll-answering message on the 

link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 
wherein said means responsive to said means for sens- 
10 mg transmits said polling message on all other links 
to which said node is connected; and 
wherein each of said remote nodes further comprises: 
means for sensing a poll-answering message re- 
ceived on one of said links from another one of 
15 said remote nodes; and 

means responsive to said means for sensing a poll- 
answering message for transmitting said poll- 
answering message received from said other one 
of said remote nodes on all links to which said 
20 node is connected. 

24. The communication network of claim 23 wherein 
said poll-responsive means comprises means for re- 
sponding only to a particular class of polling messages. 

25. The communication network of claim 24 wherein 
25 said class corresponds to contents of a predetermined 

portion of said polling message. 

26. The communication network of claim 23 wherein: 
said means for transmitting a polling message on said 

links comprises a master mode in said network, said 
30 master node being connected by respective ones of 
said links to at least one of said remote nodes; 
said communication network is co-extensive with an 
electrical power distribution network, at least some 
of said remote nodes further comprising power 
35 distribution automation apparatus and said master 
node comprising power substation control unit. 

27. The communication network of claim 26 wherein 
said distribution automation apparatus comprises at 
least one of: 

40 sensing means for monitoring a parameter of said 
electrical power distribution network, and 
regulation means for controlling apparatus in said 
power distribution network. 

28. The communication network of claim 26 wherein 
45 said master node comprises automation processing 

means for executing a set of stored application program 
instructions to manage the distribution automation ap- 
paratus of corresponding remote nodes. 

29. The communication network of claim 26 further 
50 comprising a set of secondary nodes connected to re- 
spective ones of said remote nodes by secondary links, 
wherein said link means connecting said remote nodes 
comprise fiber optic cables and said secondary links 
comprise relatively low bandwidth non-fiber optic 

55 links. 

30. The communication network of claim 29 wherein 
said power distribution network comprises a high-volt- 
age primary circuit and a plurality of low-voltage sec- 
ondary circuits receiving power through step-down 

60 transformer means from said primary circuit, wherein 
said secondary nodes are co-located with respective 
ones of said secondary circuits, said secondary links 
comprising power line carrier means for coupling be- 
tween said secondary nodes and said remote nodes 
65 through said primary and secondary circuits. 

31. The communication network of claim 23 further 
comprising bypass means in each node for permitting 
received messages to bypass a node. 
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32. The communication network of claim 23 wherein 

said communication network is co-extensive with an 
electrical power distribution substation, at least some of 
said remote nodes further comprising apparatus within 
said electrical power distribution substation. 5 

33. The communication network of claim 23 wherein 
said poll-responsive means comprises means for re- 
sponding to a polling message after receiving n polling 
messages and for refraining from responding to inter- 
vening polling messages, wherein n is an integer indi- 10 
vidually assigned to an individual node, whereby differ- 
ent nodes respond to polling messages at different rates. 

34. The communication network of claim 23 wherein 
each of said node processor means further comprises 
distributed protocol means for terminating a message 15 
which has been received at the corresponding node 
more than once. 

35. The communication network of claim 34 wherein 
said node processor means comprises: 

means for originating a message comprising an infor- 20 
mation portion; 

means for appending a unique identification number 
to said message; 

stack memory means for storing the identification 
number of each received message; and 25 

wherein said distributed protocol means comprises 
means for comparing the identification number of 
each received message with the identification num- 
bers stored in the stack memory means so as to 
determine whether to repeat the received message. 30 

36. The communication network of claim 23 wherein 

said means for transmitting a polling message on said 
links comprises a master node in said network, said 
master node being connected by respective ones of said 
links to at least one of said remote nodes. 35 

37. The communication network of claim 36 wherein: 
said remote nodes are divisible into a plurality of 

zones of said remote nodes, each of said zones 
including its own master node connected to at least 
one of the remote nodes within the zone, and 40 
said node processor means further comprises means 
for inhibiting the repeating of received messages 
not originated by a master node in the correspond- 
ing zone. 

3$. The communication network of claim 37 wherein 45 
each master node further comprises: 

means for broadcasting a changeover message in- 
structing the remote nodes in another zone to re- 
spond to messages originated in the one zone. 

39. The communication network of claim 37 further 50 
comprising gateway nodes connected to remote nodes 

in adjacent ones of said zones. 

40. The communication network of claim 39 wherein 
said gateway nodes comprise gateway node processor 
means for repeating or responding to received messages 55 
originated in the adjacent zones. 

41. The communication network of claim 40 wherein 
messages originated in adjacent zones travel along com- 
mon paths shared by the adjacent zones. 

42. The communication network of claim 37 wherein 60 
said node processor means further comprises means for 
permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 65 
riding said means for inhibiting. 


22 

43. A communication network comprising: 

a plurality of remote nodes, each of said remote nodes 
comprising node processor means for repeating 
received messages addressed to others of said 
nodes; 

a plurality of links which connect said plural nodes in 
a network of said nodes; 

means for transmitting a polling message addressed to 
at least plural ones of said remote nodes; and 
wherein each of said remote nodes comprise poll- 
responsive means responsive upon receipt of said 
polling message for transmitting a poll-answering 
message and for relaying said polling message to 
others of said remote nodes; 
wherein each remote node is connected to plural ones 
of said links, and wherein said poll-responsive 
means comprise: 

means for sensing which one of said plural links 
connected to said node said polling message 
arrived on; and 

means responsive to said means for sensing for 
transmitting said poll-answering message on the 
link on which said polling message arrived while 
simultaneously transmitting said polling message 
on another link to which said node is connected; 
wherein said means responsive to said means for sens- 
ing transmits said polling message on all other links 
to which said node is connected; 
wherein said means for transmitting a polling message 
on said links comprises a master node in said net- 
work, said master node being connected by respec- 
tive ones of said links to at least one of said remote 
nodes; and 
wherein: 

said remote nodes are divisible into a plurality of 
zones of said remote nodes, each of said zones 
including its own master node connected to at 
least one of the remote nodes within the zone, 
and 

said node processor means further comprises 
means for inhibiting the repeating of received 
messages not originated by a master node in the 
corresponding zone. 

44. The communication network of cl aim 43 wherein 
each master node further comprises: 

means for broadcasting a changeover message in- 
structing the remote nodes in another zone to re- 
spond to messages originated in the one zone. 

45. The communication network of claim 43 further 
comprising gateway nodes connected to remote nodes 
in adjacent ones of said zones. 

46. The communication network of claim 45 wherein 
said gateway nodes comprise gateway node processor 
means for repeating or responding to received messages 
originated in the adjacent zones. 

47. The communication network of claim 46 wherein 
messages originated in adjacent zones travel along com- 
mon paths shared by the adjacent zones. 

48. The communication network of claim 43 wherein 
said node processor means further comprises means for 
permitting polling of remote nodes in one zone by a 
master node of another zone upon failure of a master 
node of said one zone to poll said remote nodes of said 
one zone within a predetermined time interval by over- 
riding said means for inhibiting. 

***** 



